THREE-DIMENSIONAL SHAPE MEASURING METHOD 



[0001] FIELD OF THE INVENTION 

[0002] The present invention relates to a three- 
dimensional shape measuring method, more particularly, 
to a method of measuring an object having a three- 
dimensional shap e , by ~p roj e cting grid- p atterns up on the - 
object and using a projection image thereof. 

[0003] BACKGROUND OF THE INVENTION 
[0004] It is conventionally known to measure the three- 
dimensional shape of an object by projecting grid patterns 
upon the object and using a grid image thereby obtained 
and deformed in accordance with the height distribution of 
parts of the object, such methods being, for example, the 
m o i r_e_ m_e t h o d and the he terodyne method .C^In^the ^moi re 
^method-; a reference grid is superimposed upon the 
deformed grid image, thereby generating Moire fringes, 
which provide contour lines of the object to be measured, to 
obtain the height distribution. I^ ^h^h^terod^ ^^niet^od^ 
using a non-modulated spatial carrier frequency signal and 
a carrier signal spatially phase-modulated as the reference 
grid and the deformed grid image, the amount of 
deformation is detected as a phase, thereby obtaining the 
height distribution of the object to be measured. 



[0005] These methods are effective in. the measurement of 
a three-dimensional shape of an object having smoot h fa ces 
and parts mutual ly con tiguously connected. On the other 
hand, these methods are not applicable to measuring a 
three-dimensional shape of an object having large 
discontinuous steps nor an object composed of isolated 
- - faces-having no mutual contact-points.- -This is -because, -in— 
the case of the moire method, a fringe order of the 
discontinuous contour line cannot be uniquely determined 
and, in the case of the heterodyne method, the height 
distribution of such a discontinuous object cannot be 
uniquely determined from the phase distribution detected 
in such a manner as being folded in the range of the 
principal value of [- 7t , 7t]. 

[0006] In order to measure the three-dimensional shape of 
an object which has such discontinuous steps, Unexamined 
Japanese Patent Publication No. 10-246612 discloses a 
method comprising the steps of: projecting upon the 
object to be measured a two-dimensional grid pattern 
formed by superimposing a plurality of one-dimensional 
grids each having a period and direction different from 
those of the others; imaging a two-dimensional grid image 
deformed in accordance with the three-dimensional shape 
of the object to be measured; detecting a phase for each of 
the one-dimensional grid components from the two- 



dimensional grid image; and obtaining the measurement 
value of the three-dimensional shape of the object to be 
measured on the basis of the detected phases. 

[0007] In such a conventional method, however, if a larger 
number of one-dimensional grids having different periods 
and directions are used, there are more intersections 

— among the one- dimensional grids-in the grid image . — I-n-t -he- 
case of an increased number of intersections existing in the 
grid image, frequency separation is difficult after imaging 
the two-dimensional grid image. In this case, the one- 
dimensional grids affect each other as noise sources and, 
therefore, precise measurement of the three-dimensional 
shape of the object to be measured is made impossible. 

[0008] SUMMARY OF THE INVENTION 

[0009] The present invention was made to solve the 
aforementioned problem. More particularly, the object of 
the present invention is to provide a method of measuring 
the shape of an object having three-dimensions, with 
improved precision. 

[0010] In order to attain this object, there is provided a 
method for obtaining a measurement value of a three- 
dimensional shape of an object, using a grid image formed 
by projecting a plurality of grid patterns upon the object to 
be measured, the method comprising the steps of: 
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projecting the grid patterns upon the object to be measured, 
the grid patterns comprising a plurality of one-dimensional 
grids of different colors, each having a distinctive period 
and direction; imaging the grid patterns deformed in 
accordance with the three-dimensional shape of the object 
to be measured; separating from the grid image each of the 

— o ne - dime nsio nal- gr ids-of diffe re nt-color s ;-det ecting~a phase — 
for each of the one-dimensional grids; and obtaining the 
measurement value on the basis of the detected phases. 

[0011] The one-dimensional grids of different colors may 
be red, green and blue. Also, it is preferable that a 
straight line connecting the center of a projection lens, 
which projects light sources in the form of grid patterns, 
with the center of an image formation lens, which senses 
the image of the grid patterns, is parallel to a reference 
surface on which the object to be measured is placed. 
Furthermore, the method may further comprise a step of 
measuring color information of the object to be measured 
by imaging the object to be measured by use of white light. 

[0012] BRIEF DESCRIPTION OF THE DRAWINGS 

[0013] The invention will now be described, by way of 

example, with reference to the accompanying drawings, in 

which: 



[0014] Figs. 1A, IB and 1C are enlarged explanatory 
views of one-dimensional grids used in a three-dimensional 
shape measuring method according to one embodiment of 
the invention; 

[0015] Fig. 2 is a schematic block diagram of a device to 
which the three-dimensional shape measuring method 
according t o t h e e m b o d i m e n t i sa d a p te d ; 

[0016] Fig. 3 is a perspective view of objects to be 
measured according to the embodiment; 

[0017] Fig. 4 is an explanatory view of a two-dimensional 
grid image according to the embodiment; 

[0018] Fig. 5 is a perspective view showing an intensity 
distribution of spatial frequency spectrums of the objects 
to be measured according to the embodiment; 

[0019] Figs. 6A, 6B and 6C are perspective views showing 
height distributions of the objects to be measured 
according to the embodiment, the height distributions 
being folded in accordance with different sensitivities; 

[0020] Fig. 7 is a flow chart showing an example of 
Fourier transform processing executed in an image 
processing circuit according to the embodiment; and 

[0021] Fig. 8 is a flow chart showing an example of 
convolution processing executed in an image processing 
circuit according to the embodiment. 



[0022] DESCRIPTION OF THE PREFERRED 

EMBODIMENTS 

[0023] As shown in Fig. 1A, a one-dimensional grid 1 as 
used in this embodiment is red. The one-dimensional grid 
1 is composed of red lines periodically repeated (with 
period dl) and extending in the vertical direction. Also, 

as-shownin Fig.— IB,- a one-dimensional grid— 2- as- used in- 

this embodiment is green. The one-dimensional grid 2 is 
composed of green lines periodically repeated (with period 
d2) and extending in an oblique direction. 

[0024] Furthermore, as shown in Fig. 1C, a one- 
dimensional grid 3 as used in this embodiment is blue. 
The one-dimensional grid 3 is composed of blue lines 
periodically repeated (with period d3) and extending in an 
oblique direction of which an oblique angle is greater than 
that of the green lines. 

[0025] The one-dimensional grids 1, 2 and 3 may be 
composed of dots, instead of lines. Also, for the one- 
dimensional grids 1, 2 and 3, sinusoidal grids are ideally 
used, which contain no unnecessary harmonic components. 
However, it is also possible to use rectangular grids that 
can be made more easily, by removing such unnecessary 
harmonic components at the stage of signal processing. 

[0026] The periods dl, d2 and d3 of the one-dimensional 
grids 1, 2 and 3, respectively, in the direction of a straight 



line connecting the center of a projection lens 5 with the 
center of an image formation lens 9, both of which are 
described later, correspond to measurement sensitivities 
for transforming the height of an object to be measured into 
the phase value and, therefore, the periods dl, d2 and d3 
should have different values from each other. For 
_ ~ example, ~in case s where the - congruence-method is used as a- 
method of obtaining the height distribution of an object to 
be measured by integrating a plurality of measurement 
data obtained in accordance with different phase 
sensitivities, the ratio of dl to d2 to d3 is preferably set to 
be 3 to 5 to 7, or any other ratio represented by prime 
numbers. 

[0027] Now, as shown in Fig. 2, the one-dimensional grids 
1, 2 and 3 are illuminated, via lenses 10, 11 and 12, 
respectively, with their respective white light sources 4a, 
4b and 4c. In this embodiment, the red grid of one 
dimension 1 is disposed coaxially relative to an optical axis 
of the projection lens 5. The red grid of one dimension 1 is 
illuminated by the white light source 4a, such that an 
image thereof is projected, by the projection lens 5, upon a 
reference surface 8. 

[0028] Also, the green grid of one dimension 2 is disposed 
in parallel with the optical axis of the projection lens 5. 
The green grid of one dimension 2 is illuminated by the 
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white light source 4b, such that an image thereof is 
projected, via a prism mechanism 16, by the projection lens 
5, upon the reference surface 8. Furthermore, the blue 
grid of one dimension 3 is disposed in such a manner that it 
is opposed to the green grid of one dimension 2, with the 
optical axis intervening therebetween. The blue grid of 
" one" d i m e n s i o n 3 i s ill u m i n ated by the white 1 i gh t- s o u r e e-4 c ,- 
such that an image thereof is projected, via the prism 
mechanism 16, by the projection lens 5, upon the reference 
surface 8. 

[0029] In this embodiment, as shown in Fig. 3, three 
objects to be measured 6a, 6b and 7 are individually 
composed of isolated faces having no mutual contact points. 
The three objects to be measured 6a, 6b and 7 are placed on 
the reference surface 8, which serves as a reference plane 
for measurement of height. The image formation lens 9 
forms, in an image sensor 21, an image of the grid patterns 
projected upon the objects to be measured 6a, 6b, 7 and the 
reference surface 8, as a grid image 20. In this 
embodiment, a three-CCD camera is employed as the image 
sensor 21, and image data obtained from the image sensor 
21 are inputted into an image processing circuit 22. A 
straight line which connects the center of the projection 
lens 5 with the center of the image formation lens 9 is made 
parallel relative to the reference surface 8 such that the 



reference surface 8 serves as a reference plane for 
measurement of height. 

[0030] Furthermore, arrangement is made in such a 
manner that an optical axis of the image formation lens 9 is 
perpendicular to the reference surface 8, and a straight 
line connecting the center of the projection lens 5 with the 
center- of —the- -image- -formation- -lens— 9- -extends- -in — t he- 
horizontal direction. In this manner, the measurement 
sensitivity ratio for transforming the height of the objects 
to be measured 6a, 6b and 7 into the phase value is 
determined by a periodic ratio in the horizontal direction of 
the one-dimensional grids 1, 2 and 3, that is, dl:d2:d3, and 
is not dependent upon a periodic ratio in the vertical 
direction thereof. As a result, oblique angles of the lines 
can be selected freely when the one-dimensional grids 1, 2 
and 3 are superimposed and multiplexed. Taking 
advantage of such a degree of freedom in selecting the 
oblique angles of the lines, directions of the lines are 
determined in such a manner that spatial frequency 
spectral components of the one-dimensional grids 1, 2 and 3 
can be separated from each other, such that selective 
extraction of the spectrums is made possible by means of a 
spatial frequency filter. 

[0031] As shown in Fig. 3, one of the objects to be 
measured in this embodiment is a circular cylinder 6a 
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which is 20mm high. Another object to be measured is a 
rectangular parallelepiped 6b which is 30mm high. These 
objects to be measured 6a and 6b have large discontinuous 
steps along their edges, and are composed of isolated faces 
having no mutual contact points. The other object to be 
measured in this embodiment is a circular cone 7 which is 

25mm - -high- -at- -its — top--a-n-d -has a — continuous - height - 

distribution of a pointed shape. 

[0032] All grid patterns of the one-dimensional grids 1, 2 
and 3 are simultaneously projected upon the objects to be 
measured 6a, 6b and 7 by the respective white light sources 
4a, 4b and 4c, as shown in Fig. 2. Then, the grid image 20 
thereby made is imaged by the image sensor 21. The grid 
image 20 is, as shown in Fig. 4, deformed in accordance 
with the three-dimensional shapes of the objects to be 
measured 6a, 6b and 7. Also, in the grid image 20, three 
patterns of the one-dimensional grids 1, 2 and 3, of which 
the periodic ratio in the horizontal direction dl:d2:d3 is 
3:5:7, and which are composed of a plurality of lines 
extending in the vertical direction or in the oblique 
directions, are superimposed upon each other. 

[0033] A grid image pattern g(x, y) phase-modulated by a 
height h(x, y) of an object to be measured is represented 
using the following formula (1), where f Xk and f Yk denote 
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spatial frequencies and r(x, y) denotes a reflectance on a 
surface of the object to be measured: 

[0034] [Formula 1] 
g(x, y) = 

r (x, y) g_{ 1 + cos [ 2 nji^ x + y) + J> k (x, y) ] }■ ... W 
<p k = 2 ;r tan 0 f ^ h (x, y) 

[0035] It is possible, by spatial frequency filtering in the 
Fourier transform method, to separate <f> k (x, y) and 
individually extract the same. Each h k (x, y) thereby 
obtained is folded in the principal value of Ah k (refer to 
the following formula (2)) and, therefore, these data are 
respectively congruent, with A h k being a modulus. If the 
periodic ratio in the x-direction is selected on the basis of 
the following formula (3), where m k denote a plurality of 
simple integers prime to each other, the following formulas 
(4) and (5) are in the simultaneous congruence, with m k (= 
A h k / a ) being a modulus (refer to the following formula (6)). 
Consequently, obtaining of the height h(x, y) of the object 
to be measured results in a solution of this simultaneous 
congruence equation. 
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[0036] [Formula 2] 

Ah k = 1 / (f^ tan 0) ... (2) 

(1 1 f » * = a tan 0 (constant) ( k = 1, 2, , K) ... (3) 



X = h(x, y) / a ... (4) 



b k =h k (x,y)/a (k=l,2, ,K) ...(5) 



X - b k (mod m k ) (k = l,2, , K) ...(6) 



[0037] The grid image pattern from the image sensor 21 is 
inputted into the image processing circuit 22, where 
processing as shown in Fig. 7 is executed. In the image 
processing circuit 22, a grid image of each color is first 
separated from the entire grid image 20 comprising a 
plurality of grid images of different colors superimposed 
(step 100). Subsequently, image data corresponding to 
each grid image separated by colors are two-dimensionally 
Fourier transformed, thereby obtaining the intensity 
distribution of spatial frequency spectrums (step 110). 
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[0038] Shown in Fig. 5 is a perspective view of the 
intensity distribution of the spatial frequency spectrums 
obtained by the two-dimensional Fourier transform. 
Spatial frequency spectrums 13 and 13' of the one- 
dimensional red grid 1, spatial frequency spectrums 14 and 
14' of the one-dimensional green grid 2, and spatial 

frequency spectrums 1 5 and 15' of the one-dimension al blue 

grid 3 are separated as shown in Fig. 5, in a two- 
dimensional spatial frequency domain. Thus, spectral 
components corresponding to the spatial frequency 
spectrums of each of the one-dimensional grids 1, 2 and 3 
can be selectively extracted by means of a spatial frequency 
filter (step 120). 
[0039] Subsequently, a two-dimensional inverse Fourier 
transform is performed with respect to the spatial 
frequency spectrum selectively extracted (step 130), and 
then, a phase is heterodyne-detected (step 140). There 
are three grids of one dimension 1, 2 and 3 multiplexed in 
this embodiment; however, as it is clear in view of the 
spectral distribution as shown in Fig. 5, it is also possible 
to multiplex more one-dimensional grids of various colors 
and separate each spectrum therefrom. 
[0040] The aforementioned steps 100 to 140 are repeated, 
thereby detecting a phase for each of the multiplexed 
spectrums (step 150). Once the phases for all of the 
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multiplexed spectrums are obtained, the height 
distribution is obtained using an existing method (step 
160). As a method of obtaining the height distribution by 
integrating a plurality of measurement data obtained in 
accordance with different phase sensitivities, a congruence 
method or a coincidence method, for use in a 

— multiwavelength- interference- measurement , or any other 
method currently existing can be used. 

[0041] The heterodyne-detected phases are folded in the 
range of the principal value of [- it , tz ]. Since the 
measurement sensitivities for transforming the height of 
the objects to be measured 6a, 6b and 7 into the phase value 
are differently set in the ratio of 3:5:7, correspondingly to 
the periodic ratio in the horizontal direction of the one- 
dimensional grids 1, 2 and 3, three-dimensional shape 
distributions folded in the ranges of different heights are 
obtained for each of the frequency spectrums, as shown in 
Figs. 6A, 6B and 6C. 

[0042] A three-dimensional shape distribution 25 as 
shown in Fig. 6A is a height distribution obtained by 
extracting the spectral component 13 of the one- 
dimensional red grid 1, comprising lines extending in the 
vertical direction, by means of a filter, and then, 
performing a heterodyne detection. The three- 

dimensional shape distribution 25 is folded in the range of 
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3mm high. Also, a three-dimensional shape distribution 
26 as shown in Fig. 6B is a height distribution obtained by 
extracting the spectral component 14 of the one- 
dimensional green grid 2, comprising lines extending in an 
oblique direction, by means of a filter, and then, 
performing a heterodyne detection. The three- 

— dimensional-shape-distribution-26 is folded in -the-range of - 
5mm high. 

[0043] Furthermore, a three-dimensional shape 
distribution 27 as shown in Fig. 6C is a height distribution 
obtained by extracting the spectral component 15 of the 
one-dimensional blue grid 3, comprising lines extending in 
an oblique direction, by means of a filter, and then, 
performing a heterodyne detection. The three- 

dimensional shape distribution 27 is folded in the range of 
7mm high. In these manners, it is possible to 
simultaneously obtain a plurality of measurement data, in 
accordance with three different sensitivities, from the grid 
images of the one-dimensional grids 1, 2 and 3 of different 
colors as shown in Figs. 1A, IB and 1C. If more grid 
patterns of various colors are multiplexed, even more data 
measured in accordance with different sensitivities can be 
obtained. 

[0044] When a conventional heterodyne method is adopted, 
in which case no multiplexing of spatial frequencies is 
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performed unlike the method of the invention, any one of 
the height distributions 25, 26 and 27 folded as shown in 
Figs. 6A, 6B and 6C, respectively, is only obtained. In the 
case of objects to be measured having large discontinuous 
steps along their edges and composed of isolated faces 
having no mutual contact points, such as the objects to be 

- measured -6a-and 6b-in-Fig^ 3 7 -it— is-impossible to-uniquely- 
determine the three-dimensional shapes thereof in view of 
any one of the height distributions 25, 26 and 27. 
Accordingly, it is essential to simultaneously obtain a 
plurality of measurement data, in accordance with a 
plurality of different sensitivities, from the grid image 20 
comprising a plurality of one-dimensional grids of different 
colors, like the method of the invention. 

[0045] As a method of determining a three-dimensional 
shape by integrating the data of the three height 
distributions 25, 26 and 27, as shown in Figs. 6A, 6B and 
6C, respectively, folded in the height sensitivity ratio of 
3:5:7, the congruence method, which is well known in the 
field of multiwavelength interference measurement, may be 
used. Using this method, the three-dimensional shape 
distributions of the objects to be measured 6a, 6b and 7, as 
shown in Fig. 3, can be precisely obtained. 

[0046] For processing equivalent to two-dimensionally 
Fourier transforming the entire grid image 20 and 
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performing filtering for selective extraction of desired 
spectral components, it is also possible to carry out direct 
operations with respect to the grid image 20. More 
specifically, as shown in Fig. 8, each grid image is first 
separated by colors from the superimposed grid image 20 
(step 100). Subsequently, a two-dimensional filter 

- ^window function - used in selective- extraction of desired 
spectrums is inversely-Fourier transformed in order to 
obtain a two-dimensional impulse response function (step 
200). Then, using the obtained two-dimensional impulse 
response function, a direct, two-dimensional convolution 
operation is carried out with respect to the grid image 20 
(step 210). In this manner, the spectral components 
corresponding to the respective spatial frequencies of the 
one-dimensional grids 1, 2 and 3 can be selectively 
extracted. The following processes (steps 130 to 150) are 
the same as aforementioned and, therefore, reference 
thereto is not made here. 

[0047] According to the method of the present invention, 
the spatial frequency multiplexed grid image 20 deformed 
in accordance with the respective three-dimensional shapes 
of the objects to be measured 6a, 6b and 7 is imported into 
the image processing circuit 22, and a grid image of each 
color is separated from the entire grid image 20, and the 
spectral components corresponding to the respective 
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spatial frequencies of the one-dimensional grids 1, 2 and 3 
are selectively extracted by means of the spatial frequency 
filter, and then, the phases of the spectral components are 
individually heterodyne -detected. 
[0048] This processing of spatial frequency filtering may 
be carried out in a frequency spectral region, where the 

d © f o r m e d g r i d — image i s 1 w o^d i men s i o n a 1 ly F-o-u r-i-e-r — 

transformed. Otherwise, the two-dimensional convolution 
operation equivalent to such processing may be directly 
performed in relation to the two-dimensional grid image. 
The heterodyne-detected phases are folded in the range of 
the principal value of [- Tt , 7t]. Since the measuring 
sensitivities for transforming the height of the objects to 
be measured 6a, 6b and 7 into the phase value are different 
depending on the spatial frequencies of the one- 
dimensional grids 1, 2 and 3, various three-dimensional 
shape distributions are obtained in which the phases are 
folded in the ranges of different heights depending on each 
frequency spectrum. 
[0049] Consequently, it becomes possible, by integrating 
a plurality of measurement data obtained from the spectral 
components of the one-dimensional grids 1, 2 and 3, to 
individually determine the height of the objects to be 
measured at each single measurement point, regardless of 
existence of discontinuous steps or isolated faces on the 
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objects to be measured. Also, instantaneous measurement 
is possible by only one-time projection of the grid patterns, 
thereby enabling the measurement of an instantaneous 
shape of a discontinuous object during its high-speed 
movement or high-speed deformation. 

[0050] In addition, the entire grid image is separated by 
colors, ~ nrore specificaTlyr into a- red 7 green and blue grid 
images and, therefore, each grid image separated by colors 
has no portion where the grid images of different colors 
intersect. Consequently, the noise generated by the grid 
images of the other one-dimensional grids 1, 2 and 3 can be 
abated, which results in a high-precision measurement of 
the shape. Furthermore, as shown in Fig. 2, a ring-shaped 
white color source 31 is disposed coaxially relative to the 
image sensor 21, such that white light is projected upon the 
objects to be measured 6a, 6b and 7 from the white color 
source 31, while color images of the objects to be measured 
6a, 6b and 7 are imaged by the image sensor 21. From 
each pixel of the color images, color information of the 
objects to be measured is obtained. In this manner, the 
color information as well as the measurement data on the 
three-dimensional shape can be obtained at the same time. 

[0051] The present invention is, of course, not restricted 
to the embodiment as described above, and may be 
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practiced or embodied in still other ways without departing 
from the subject matter thereof. 

[0052] As mentioned above, adopting the three- 
dimensional shape measuring method of the invention, it is 
possible to instantaneously measure the three-dimensional 
shape of an object having large discontinuous steps or 

_ c_o m p o s e.d_o f _i s o 1 a t e d f a c es-h a v i n g n o m u t u a 1 c o n tact point s , - 
by only one-time projection of grid patterns upon the object. 
Consequently, measurement of an instantaneous shape of a 
discontinuous object during its high-speed movement or 
high-speed deformation is also made possible, which has 
been difficult according to the conventional measuring 
methods. In addition, the entire grid image is separated 
by colors and, therefore, each individual grid image after 
separation has no portion where the grid images of 
different colors intersect. Consequently, the noise 
generated by the grid images of the other one-dimensional 
grids can be abated, which results in a high-precision 
measurement of the shape. 



